Towards Automatic Interpolation for Real and Distant Image Pairs

Image-based rendering o ers the advantage of being able to provide realistic output and at the same time to avoid the di cult problem of a complete geometric and photometric modeling of the real world. The method described here is able to deal with non rigid scenes and large camera motions. We present in this report a three step algorithm for the interpolation of two views of a scene, from which we can for instance simulated a camera motion withing the given scene. The rst step establishes pixel correspondences between the images and is the most di cult part. We justify the choice of region-growing based dense matching methods and we summarize their principle. Secondly, a robust algorithm converts these pixel correspondences to an adequate structure for the last step: image interpolation. This structure encompasses the transformation between the images using constrained and dependent triangulations in both of them, and handles the half-occluded areas. The implementation of the whole process is outlined and the process is demonstrated on real images. Key-words: Image Matching, Correlation, Region Growing, Constrained Delaunay Triangulation, Visibility, Interpolation, Morphing, Image-Based Rendering